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Abstract: In several application fields like daily pluviometry data mod- 
elling, or motion analysis from image sequences, observations contain two 
components of diff'erent nature. A first part is made with discrete values ac- 
counting for some symbolic information and a second part records a contin- 
uous (real-valued) measurement. We call such type of observations "mixed- 
state observations". 

This paper introduces spatial models suited for the analysis of these 
kinds of data. We consider multi-parameter auto-modcls whose local con- 
ditional distributions belong to a mixed state exponential family. Specific 
examples with exponential distributions are detailed, and we present some 
experimental results for modelling motion measurements from video se- 
quences. 
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1. Introduction 

In many applications, it is frequent to get observations with two components of a 
different nature: the first component is made up of discrete values and the second 
component records a continuous measurement. For example, pluviometry time 
series at a given site records many zeros for dry days, followed by positive and 
continuous records for wet periods [2, 1]. Similar phenomena also occur in speech 
recordings where interchanges are permanent between absences and presences 
of the signal. Other examples arise in the motion analysis problem from image 
sequences [•">], or in epidemiological data analysis where the disease at given 
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locations can be absent or spreads out. We call such type of measurements 
mixed-state observations. It then raises the question to find accurate models for 
these types of data. 

To deal with data of mixed nature, most of the existing approaches rely on 
an hierarchic approach. One introduces a hidden variable to distinguish discrete 
observations from continuous ones. Or equivalently, the discrete values are in- 
terpreted as resulting from some unobserved censoring variable [2] . Specifically, 
a Bayesian approach is used for statistical inference. 

Our approach is different. We propose a direct modelling by considering ran- 
dom variables which can take discrete values as well as continuous ones. Al- 
though the idea seems absolutely natural, we are not aware of any statistical 
models relying on such a direct approach for mixed-state data. 

The main motivation of the paper is a search for spatial models for observa- 
tions {Xs\ such that each is a mixed-state random variable. In the spatial 
context, the discrete components could not be simply neglected, because these 
symbolic values as well as their spatial correlations convey important point-wise 
and contextual information. To this end, we introduce a new class of auto-models 
for such mixed-state data. Their construction proposed in this paper relies on 
an adaptation to the present context of a general class of Markov random fields 
models, namely multi-parameter auto- models, that we recently introduced in [9]. 
Roughly speaking, an auto-model, as introduced originally in [4], is a Markov 
field on a finite set of sites, for which the interactions between sites are pairwise 
only, and each local conditional distributions belongs to some exponential fam- 
ily. The multi-parameter auto-models of [9] extend the classical one-parameter 
auto-models of [4] and several known spatial models previously proposed in 
[6, 10, 11]. 

The plan of the paper is the following. We first present mixed state random 
variables in a simple context where the observation is made up with and val- 
ues in (0, oo). The distribution of this mixed state random variable has two 
main features; it reflects the dual character of the observation, and the distri- 
bution belongs to an exponential family. In §3, we give the general definition 
for mixed-state variables. We recall in §4 results on general multi-parameters 
auto-models of [9] which constitute the starting blocks of our construction of 
auto-models for mixed-state observations that we present in §5. We wet out in 
§6 a detailed study of mixed-state auto-models where neighbouring sites are 
spatially cooperative. This property contrasts with many classical auto-models 
introduced in [4] which lead to a spatial competitive behaviour, which is clearly 
inadequate in many practical situations. We conclude the paper by an analysis 
of motion measurements from video sequences, using a mixed positive Gaussian 
auto- mo del. 

2. Simple random variables with mixed states 

Before defining general mixed state variables, let us begin with the simplest 
situation where the state space is i? = {0}U(0, oo). Of course E — [0, cxo), but the 
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split formula has the merits to insist on the null value which plays a particular 
role in the construction. A mixed-state random variable X on E \a defined as 
follows: with a probability 7 G [0, 1] we set X = 0, and with probability 1 — 7, X 
follows a continuous distribution on (0, 00) with a probability density function g. 

Formally, we equip E with its Borcl field S and we introduce a reference 
measure of mixture type 

m{dx) = 5n{dx) + X{dx) , (2.1) 

where Sq is the Dirac measure at and A the Lebesgue measure. Throughout the 
paper, we denote by 1a the indicator function of a set A. For the particular case 
of {0}, we use a simpler notation by setting (5(a;) — l{o}(2;) and S*{x) = 1 — S{x). 
The above mixed-state variable X then has a probability density function with 
respect to m given by 

f{x)=jS{x) + il-j)S*ix)gix), xeE. (2.2) 

Clearly, such mixed-state random variables (or distributions) can provide accu- 
rate modelling for the marginal empirical distributions discussed in §1. 

For the upcoming construction of spatial models, we are interested in mixed- 
state random variables of a particular type, namely their continuous component 
g belongs to a dimensional exponential family 

g{x) = g^{x) = H{C)Lix) exp(C, T(a;)) , ^ e M^ T{x) e (2.3) 

for some sufficient statistics T and measurable positive functions H and L {{,) 
denoting the scalar product in K^). Interestingly enough, the mixed-state dis- 
tribution can also be put in the form of an exponential family. Indeed, 



fix) = fe{x) - jSix) + (1 - 7)<5*(x)55(x) 
= exp 

^ H'{e)L'{x)eyip{9,B{x)), (2.4) 



S* {x) In ^^^^^^ + (e, T{x)5* (x)) + log 7 + 6* {x) log L(.t) 
7 



with H'{6) ~ 7, L'{x) ~ exp{(5*(a;) logL(x)}, and the natural parameter and 
the sufficient statistics defined by 




Note that with the standard convention OlogO = 0, these formula are still 
valid in the extreme situations 7 S {0, 1} which correspond to a purely continu- 
ous and a purely discrete distribution, respectively. Therefore, the mixed-state 
distribution fg belongs to an exponential family, of dimension £ -\- 1. Moreover 
the original parameters f and 7 can be recovered from by 



Hi92) + e« 
Let us consider some examples. 
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Example 1. Mixed-state Exponential distribution: this simple distribution is 
obtained with g\{x) = Xe^^^ where A > 0. Then ^ = = A and T{x) = —x. 
The parametric dimension of the resulting mixed-state distribution equals two. 

Example 2. Mixed-state Gamma distribution: this situation generalises Ex- 
ample 1 by substituting a Gamma distribution T{a,b), a,b > 0, for the ex- 
ponential distribution. Here we have = (6, a — 1), -ff(^) = r(a)~^6° and 
T[x) = (— Xjinx). The resulting mixed-state distribution belongs to an expo- 
nential family of dimension three. 

Example 3. Positive mixed-state Gaussian distribution: here the continuous 
component of X is the distribution of the modulus of a zero-mean Gaussian 
distribution with variance a^. We have 9 = (In^^^-T^l — L)""^ and B(x) = 

{5*{x)~x'Y. 

3. General random variables w^ith mixed states 

To cover situations involving several atomic values, the previous simple model 
need to be extended. Let F — {ei, . . . , cm} be a finite set of M elements and G 
a Borel subset of an Euclidean space WP . Let q = (gi, . . . , gjif ) be a probability 
distribution on F and g a probability density function on G (with respect to 
the Lebesgue measure). 

We define a general mixed-state random variable X as follows: 

• with a probability 7 G [0, 1], X takes values in F with distribution q; 

• with probability 1 — 7, X takes values in G according to the density func- 
tion g. 

Although the nature of the discrete state space F could be arbitrary (possi- 
bly qualitative), we are going to embed F in W to ease the development of a 
likelihood-based estimation theory. In other words, we set the state space of X 
to be 

£:= {ei,...,eM}UG, eieW\G, G C . 

Therefore, we can supply E with its Borel field and a reference measure of 
mixture type 

M 

m{dx) = (5e. (dx) + X{dx) (3.1) 
1=1 

where 6e denotes the Dirac measure at a point e € W and A the Lebesgue 
measure on E. Then the mixed-state variable X has the the following density 
function with respect to m: 

M 

f{x)=^lF{x)Y,qd{e,}{x) + {\-^)lG{x)g{x), xeE. (3.2) 

i=l 
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3. 1 . Exponential family case 



We focus now on mixed-state distributions which belong to some exponential 
family. To avoid trivial situations, we assume that 

• the discrete distribution q is everywhere positive: > (i = 1, . . . , AI). 

• the density g of the continuous component belongs to a £— dimensional 
exponential family as in (2.3). 

We first write the discrete distribution q in an exponential family form, 
through the logistic transformation: 



log , 

qM 



1, 



We notice that by definition = 0. Wc have, 

M M 



^gil{e.}(a;) = exp^ l{e,}(a;)(fci + logg^/), x G {ei, . . . ,eA/}. 



i=l 



i=l 



Combining this writing with (2.3) and (3.2), we get 
.f{x) = .fe{x) 



cxp 



M 



^f{x) I ^ l{ei}{x){h +loggA/) + log7 



. i = l 



+ 1g{x) {log[(l - j)H{OL{x)] + {^,T{x))} 



exp 

M-l 



laix) log ^^^^^^ + (C, T(x)1g(x)) 



hl{e,}{x) + \og{jqM) + lG{x)\ogL{a 



i=l 



= H'{e)L'{x)eyi-p{0,B{x)), x e E, 



(3.3) 



where H\0) = log{jqM), and L'{x) — L{x)^'^^'^'> . In other words, fg belongs to 
an exponential family of dimension £ -\- M with the natural parameter and the 
sufficient statistics given by 



/ ^1 \ 

^M-l 

Qm 
\Om+iJ 



( 



\ 



logii^lWSl 



V 



7<?A/ 



, B{x) 



J 



( ^{ei}{x) \ 

l{eM-i}(a;) 
Ig{x) 
\T{x)Ig{x)) 



x&E. (3.4) 
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Note that ^^A/+l and T{x)\g{^) a-rc ^-dimensional vectors, and by definition 
B{eM) = and i'(ej\/) = 1. Furthermore, the original parameters ^, q and 7 
are recovered through the formulae 

ki = 9i, 1 <i < M, 

C = ^M+l, 

Qi = —, 1—1 l<i< M, 



7 



HiO + me' 



It is worth noticing that in the case oi E = {0}U(0, 00), the formulae (3.3)-(3.4) 
reduce to equations (2.4)-(2.5) of the previous section. 



3.2. Example of a mixed-state and censored exponential variable 

Let Z be an exponential random variable with parameter A, censored at a known 
location K > 0. The probability density function of Z is defined by g{z) = 
Ae-^^ l(o,x)(2) + e-^^(5if(z). 

We define the following mixed-state variable X: with probability a, X takes 
the value ; with probability 1 — a, X has the distribution of Z . Therefore, 
X has masses {a, (1 — a)e^^^} on the atoms {0, K}, and a continuous density 
function (1 — a)Xe^^^ on {Q,K). Equivalently, X can be viewed as a general 
mixed-state variable with the state space E = {0, K} U (0, K) = [0, K] and the 
following parameters 

7 

q 

Following (3.3) and (3.4), the distribution of X belongs to an 3-dimensional ex- 
ponential family with the following natural parameters and sufficient statistics: 

nogj^ + \K\ I l{o}(x) \ 

e=\ log A -f AX , B{x)^\ l(o,K)(a^) , xeE. 

V ^ / \-~xl(Q,K){x)) 

4. Results on multi-parameter auto-models 

The construction of spatial models for mixed-state observations relies on the 
general theory of multi-parameter auto-models developed in [9] . We quote below 
its main results which are relevant for the present purpose. 



a 4- (1 — a)e ^'^ 

^ x€{Q,K). 



1 - e 



-\K 
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Let us set some notations. Let S* = {1, . . . , n} be a finite set of sites equipped 
with a symmetric graph Q without loops. We denote by {i, j} a pair of neigh- 
bouring sites (in particular, i ^ j). For any subset A of S*, let XA=^{xi,i& A) 
and = (xj, J &S\A). The neighbourhood of a site i is 9i = {j £ S* : (i, j) }. 
We shall write = x'^*^. The variates Xi take their values in a measurable state 
space {E,£,m). Most of the time, E will be a subset of R^. The configuration 
space 51 = E^' is equipped with the cr-algebra S'^^ and the product measure 
ly := m^^ . A random field is specified by a probability distribution ^ on fl, and 
we assume the positivity condition, that is fi has an everywhere positive density 
P with respect to v. Consequently we write 

H{dx) = P{x)v{dx) , P{x) = Z-^ cxp Q{x) , (4.1) 

where Z is a normalisation constant. From the Hammersley-Clifford Theorem, 
the energy function Q{x) is a sum of potentials [Ga] A S 'rf} indexed by a set 
of cliques. Let us fix a reference configuration, or "ground states", r = (r^) el] 
yielding to the potentials normalisation: for any potential Ga(x^) where A C S, 
we have Ga(xa) = if = for some i £ A. This implies Q{t) ~ and 
= P(r) in (4.1). 

The class of multi-parameter auto-models defined in [9] extends the classical 
one-parameter auto-models of J. Besag in its seminal paper [4]. Their construc- 
tion rely on the following assumptions. 

Assumption 1. The dependence between the sites is pairwise only; in other 
words, 

Q{x) = ^Gi(xj) -I- ^ Gij{xi,Xj) . 
ies {uj} 

Assumption 2. For an integer k > I and all i G 5, the conditional distribution 
of Xi given X* = x' relics in an exponential family 

log/,(x,|x^) = (0,(x''),S,(x,)) +C,(x,) + A(x'') , 9,{x') € R^ S,(xO 6 W\ 

Assumption 3. For all i e S, Span{i?i(xi) : Xi e E} ~ M'^. 

The following result of [!)] determines the necessary form of the local natu- 
ral parameters {Oi{.)} to ensure the compatibility of the family of conditional 
distributions. 

Theorem 1. (Hardouin and Yao [')]). Assume that Assumptions 1-3 are sat- 
isfied with the normalisation Bi(Ti) = Ci{Ti) = in Assumption 2 for all i E S . 
Then, necessarily, the functions 6i take the form 

e,{x') =a, + Y, PvBjixj) , i&S, (4.2) 

where {ai : i £ S} is a family of k- dimensional vectors, and {j3ij : i,j € 
S, i j} is a family of k x k matrices {Pij} satisfying (3jj = (3ji. Moreover, the 
potentials are given by 



Gi{xi) = {ai,Bi{x,)) +Ci{xi) , 



(4.3) 
(4.4) 
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A model satisfying the assumptions of this theorem is caUed a multi-parameter 
auto-model. For a concrete construction of such a multi-parameter auto-model, 
one follows a two steps method: first, specify the family of cliques (Assumption 
1), and the family of conditional distributions (Assumption 2); secondly, find the 
admissible set of parameters {a^, /3y } which ensures the integrability condition: 



We refer the reader to [9] and the references therein for more account on this 
new family of auto-models. 

Another important question about the model is that of spatial symmetry. The 
general formulation given above does not impose any symmetry, and hence it can 
be useful for modelling random fields on arbitrary or oriented graphs. However, 
in the case of a spatially symmetric random field, all potentials Gij{xi,Xj) are 
necessarily symmetric functions; equivalcntly, all the matrices (3ij are symmetric. 

5. Auto- models for mixed state variables 
5.1. The construction 

Following the general theory of multi-parameter auto-models quoted above, we 
now construct auto- models for general mixed-state variables X = {Xi, i € S} 
on a finite set S. The state space for each variable Xi is E = F U G as defined 
in §3. We let the configuration space fl = = {F \J G)^ be supplied with the 
product measure v = m'^^ , where m is defined by (3.1). 

We assume that Assumptions 1-3 are satisfied, where in Assumption 2, the 
family of conditional distributions fi{xi \ •) belongs to the family of mixed-state 
distribution given in (3.3). In other words. 



with 0^{-) e M^+^ and Bi{-) G satisfying (3.4). 

Note that by definition, Bi{eM) = and L'{eM) — 1. Therefore, the state 
Cm serves as a reference state for coordinates Xi and the reference configuration 
becomes r = (bm, ■ • ■ , gm) for the application of Theorem 1. 

Following Theorem 1, there exist a family of {i -\- M)— dimensional vectors 
{ofj : i e S} and a family of {£ -\- M) x {i -\- M) matrices : i,j G S, i ^ j} 
satisfying /3y = /3^, such that 




(4.5) 



Mx^ I x') = H'^{x')L[{x^)cM0^ix'),B^{x^)) 



(5.1) 




(5.2) 



The families of potentials are given by 



Gt{xi) = {a^,B,{x^)) + log L[{xi), 
Gij (xj ,Xj) = BJ {xi)l3ij Bj {xj ) . 
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Let us note that two variables Xi and Xj arc (spatially) conditionally in- 
dependent, given {Xk, k ^ if (and only if) /3y = 0. In this case, we 
say that the sites i and j are neighbours. Thus the neighbourhood di of i is 
the set {j : (iij ^ 0}. Moreover we can substitute by XQi in the previous 
equations (5.1) and (5.2). 

These auto-models for mixed state variables are completely and well defined 
once we choose admissible parameters {ai,/3y} that ensure the integrability 
condition (4.5). 

5.2. Spatial cooperation behaviour 

In many practical situations, we need to investigate the properties of local in- 
teractions of the system. Indeed, we want to know whether the field is spatially 
cooperative or spatially competitive (or neither of them). A standard defini- 
tion of spatial cooperation (respectively, competition) is that at each site i, 
the conditional expectation E \Xi \ a;*] increases (respectively, decreases) with 
each neighbouring value Xj, j ^ i. For mixed-state auto- models valued in 
~ (F U G)"^, we must adapt these definitions. For each i we define the 
function — > R[x^) = E [XilG(Xj) | x'] and we study its variations in each 
coordinate Xj of a;*, where Xj € G and Xj £ di. Then we define spatial coopera- 
tion (or competition) similarly as the classical definition by substituting i?(x') 
for E [Xi I xoi] ■ Let us note that this definition coincides with the classical one 
in the case E = G. 

In the particular case where E = {0} U (0, oo) with F = {0} and G ~ (0, oo), 
for any random mixed state variable X on as defined in §2 with density 
function (2.2), we have 

/"OO 

E[X] = (1 - 7) / X g{x) dx={l- 7)S[X|lx>o] = E[X1g{X)]. 
Jo 

Then we conclude that for mixed state variables in E^ = ({0} U (0, oo))'^, 
the generalised definition for spatial cooperation (competition) above meets the 
classical one. This will not occur anymore in the case of an atomic value different 
from zero. 

5.3. A translation invariant and symmetric mixed-state auto-model 
with the four nearest neighbours system 

Let us consider the four nearest neighbours system on a two-dimensional lattice, 
S = [l,M] X [1,N]: each site i G S has four neighbours denoted by {ie = 
i -j- (0, 1), iw ~ i — (0, 1), in = i — (1,0), is — i + (1, 0)}, with obvious neighbour 
adjustments near the boundary. We assume translation invariance in the sense 
that the parameters are functions of the displacement between sites; we assume 
spatial symmetry, which implies that the matrices /3y = (3ji are symmetric; we 
allow possible anisotropy between the horizontal and vertical directions. Under 
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all these conditions and from the result above, there exist a (^+ A/)— dimensional 
vector a and two + M) x (£ + M) symmetric matrices {/3^^\ Z?^^-*} such that 
for all i, ai = a, and, for all {«, j}, , Pij = unless i and j are neighbours, in 
which case 

Moreover, the translation invariance implies that the local conditional density 
function fi, hence the functionals 9i, Bi , H[ and L[ in (5.1), are independent 
of i. The potentials are given by 

Gi{xi) = G{x^) = {a,B{xi)) +\QgL'{xi), 

{b'^{x,)P<^^'^B{x,), i-:i = ±{0,l), 

G,j{x,,Xj)=G{x,,Xj) = Ib^{x^)P'^^^B{xj), i-j = ±(l,0), 

[O, otherwise. 

The natural parameter of fi equals to 

e,{x') = e{xo,) = a + /3(i) {B{x,^ ) + )} + {B{x,^ ) + B{x,J}. (5.3) 

5.4- Parameter estimation 

It is well-known that the maximum likelihood method needs intensive compu- 
tational approximations for Markov random fields. An efficient remedy relies on 
the pseudo- likelihood estimator introduced by [4]. Theoretical results for this 
estimator in the general framework of Markov random fields can be found in 
e.g. [(S]. In the case of multi-parameter auto-modcls, ['.)] provide conditions un- 
der which this estimator is consistent. We refer the reader to this paper where 
this theory is developed in details. In particular, it applies to the present class 
of mixed-state auto-models. In the later §7, we will use this pseudo-likelihood 
estimator for the modelling of motion measurements from video sequences. 

6. Mixed exponential auto-models 

In this section, we focus on auto-models with mixed exponential conditional 
distributions. The relative simplicity of the model allows us a complete study 
of the various properties of the model, without getting bogged down in the 
parameters. Moreover, the exponential distribution itself is commonly used for 
modelling, e.g., records of pluviometry data. 

From Besag's seminal paper [4], we know that several classical auto-models 
imply spatial competition between the neighbouring sites. This is particularly 
the case for the auto-exponential scheme. We will see that this fact appears 
again for mixed-state auto- model with exponential distributions. To overcome 
this limitation, we propose two alternatives by means of data truncation or data 
censoring. 
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6.1. Mixed state auto-models with exponential conditionals 

We consider the mixed state space E = {0} U (0, oo), and we assume that the 
conditional distributions fi{xi \ ■) belong to the family of mixed state exponen- 
tial distributions as defined in Example 1 of §2. We write 

Ji{x, I x") = f,{Xi I XQi) = -1,{xQi)5{Xi) + (1 - -1i{xq{))5* {;Xi)gx^(xoi){Xi) 

= H[{xi)i)e-K]i{0i{xdi),B{xi)), 

where the natural parameter and the sufficient statistics arc, noting that 
x6* (x) = X, 



V l'i{xdi) 

B{x)^{6*{x),-xf . 



T 



Here, the reference state is 0. Besides, obviously, the family of efficient statistics 
B{x) verify Assumption 3. Therefore, following the previous general result for 
mixed state auto-models: there exist a family of vectors = (a^, 6^)'^ and 2x2 

matrices /3y = ( | , with /3y = pj^ , such that the energy function equals 
\.tij e.ij J 

Q{xi, ...,Xn) = ^{aid*{xi) - biXi) 
i&S 

+ ^ {cij6*{xi)5*{xj) - dij5*{xi)xj - fi]Xi5*{xj) + CijXiXj) . 

We note that the model can be spatially asymmetrical if ^ fij. This is 
particularly interesting for our mixed state auto-models, where 5*{xi)xj and 
Xi5*{xj) may be interpreted as different situations. We can also think about 
models with oriented graphs. 

The local natural parameters are 

di,t{xQ^) = Gi + ^ {cij6*{xj) - d.ijXj) , (6.1) 
d2,t{xdi) = bi + ^ {fi-jS*{xj) - CijXj) . (6.2) 
And we also have the reciprocal correspondence 



\{xd{) = 92,t{xdi) , ii{xei) 



It remains to make certain the well-definiteness of the model, that is to ensure 
the integrability condition (4.5). Necessarily, we must have for all i, 7^ G [0, 1] 
and Xi > 0. Since the ccj's belong to [0, 00), this leads to require the following 
conditions: 
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(i) for all eij < 0. 

(A) ( ii) for all i and any subset A C 6,; + J2 fij > ^ (in particular bi > 0). 

Fortunately enough, these necessary conditions also ensure the integrability 
condition (4.5). 

Proposition 1. Under Conditions (A), the auto-model with mixed exponential 
conditionals is well-defined. 

Proof. The configuration space f2 can be decomposed as 

Q = ^ r^A, with Ha = {x : Xi > 0, i e A; Xi = 0, i ^ A} . 

Acs 

We have 

/ 6xp 

Q{x)iy{dx)^J2 / expQ(a;) m'^^'{dx), 

■/ O ^ 5 

with m{dx) ~ So{dx) + X{dx). Therefore, Condition (4.5) holds if and only if 

VACS', / expQ(2;) m®'^(da;) < +oo. 
Moreover for x G ^Ia, with fij ~ dji, 



Q{x) = Y[ai ~ biXi] + ^ {l,-Xi)/3ij{l,-:. 

ieA {i,j}CA 



ieA i,jeA,{i,j) ieA 



jeA:{i,j) jeA:{i,j) 



As eij < , we have for some constant C > 0, and still x G Ha, 



C-'Qix) <-Y[b'+ -^'^ 
ieA \ jeA, J 

Let \A\ — card(A). By Conditions (A), hi + J2jeA {i j) fij ^ ^ ^^'^ finally 
obtain 

/ expQ(a;) m^^{dx)^ / exp (5(a;) TT A((ia;i) < oo. 

JnA J(o,oo)i-4i 

The proof is complete. □ 

Let us notice that in the context of n "ordinary" variables, [3] claim that 
Condition (A) is both necessary and sufficient for n > 2. This is true for n — 2 
but the condition is not necessary anymore if n > 3. 
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Let us examine local interactions between neighbouring sites. Considering 
the generalised definition of spatial cooperation (respectively, competition) for 
mixed-state auto-models given in §5.2 , we are looking for the variations of 

E [X^lx,>o I XQi] = (1 - li{xdi)) a — 7 — r 

I 1 

1 + 6'2,i(a;ai)cxp{-0i,j(a;ai)} 92^t{xdi)' 

Under Conditions (A), in particular e,;j < 0, we see that the parameter 02^i{xQi) 
defined in (6.2) is an increasing function of neighbouring values Xj > 0. As 
E [Xilxi>o I XQi] is a decreasing function of 92,iixgi), we conclude that the 
model cannot be spatially cooperative, although the precise dependence of the 
other parameter Oi^ilx"^) in the Xj^s will vary according to the values of the 
{dijYs. Similarly to the auto-exponential scheme of [4], this locally non coop- 
erative behaviour seems inappropriate in many application fields. 

To overcome this drawback, there are two commonly used approaches, namely 
data truncation and data censoring. We adapt below these two methods for 
mixed exponential auto-models. 



6.2. Cooperative mixed exponential auto-models by truncation 

First let us define a mixed truncated exponential variable X. The state space is 
E = {0}U(0, K] where K is a. given (arbitrary) positive constant. The continuous 
component on (0, K] of X follows a truncated exponential distribution with the 
probability density function 

gx{x) = i/(A)e-^n(o,K](x), H{X) = j^^- 
Thus, the probability density function of X equals 

fg{x)^H'{e)cMe,B{x)) 

with 

e = {e,,e2f = (^iog ^^"^^^^^\ xj , b{x) = {5*{x),~xi^„^i,]{x)f. 

Note that conversely we have 

\ _ n _ ^2 

^~ 02 + e»i(l-e-»^^)' 

Let us consider a mixed-state auto- model for X = {Xi, i E S}, whose condi- 
tional distributions lay in the family of the mixed truncated exponential distribu- 
tions above. Here the reference state is and the family of sufficient statistics B 
verify Assumption 3. By Theorem 1, there exist a family of vectors ai = {ai,bi)^ 
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and 2x2 matrices (3ij = { j , with fiij — f3ji , such that the energy func- 

\Jij Gij J 

tion equals 

. . . ,a;„) = ^(aj,6j)B(xi) + ^ B{xi)^ l3ijB{xj). 

Because of the truncation, exp Q is always integrable. 

The natural parameters of local conditional distributions are written 

As for the conditions on the parameters, we keep the requirement: Oi^2{xdi) > 
(which implies ^i{xQi) G (0, 1)). This is clearly satisfied under the following 

Assumption 4. For all i € S, bi + J2j£di niin(0, fij, fij — SijK) > 0. 

To understand whether the system is spatially cooperative or not. let us 
first examine, for the mixed truncated exponential variable X , the variation of 
E[Xl(^f)^K]{^)] with respect to its parameters {0i,92}- If we denote Z a random 
variable following a truncated exponential distribution with the density g\, a 

simple calculus leads to E[Z] = K — ^\k_i ^ , which decreases from to 
when A raises from to oo. On the other side, 1 — 7 is decreasing with respect 
to 02 and increases with 0i. Finally, E[X\(^q k]{X)] = (1 — ^)E{Z) is decreasing 
in 02 and increasing in 9i . 

Gathering this result together with (6.3), we deduce the variation of 
E[Xi\.(Q K]{.Xi) I Xdi]-, relatively to the neighbouring values Xj, j £ di which 
are positives. Let us introduce the following assumptions. 

Assumption 5. For all i, j G S, dij < 0, > 0. 
Assumption 6. For all i, j £ S, dij > 0, < 0. 
We thus have proved the following 

Proposition 2. Assume Assumption 4 holds. Then, 

(i) The mixed auto-model with mixed truncated exponential conditionals is 
well-defined. 

(a) The model is spatially cooperative under Assumption 5. 
(Hi) The model is spatially competitive under Assumption 6. 

Therefore, this family of auto-models can exhibit spatial cooperation as well 
as spatial competition. 

Let us give an application to the translation invariant and symmetric scheme 
with the four nearest neighbours system, as introduced in §5.3, and with the 
additional assumption of isotropy. Then the parameters are a = (a, 6)^ and 

In this case, Assumptions 4 and 5 reduce to the conditions 
d<0, e > 0,6 + 4(d- eA') > 0, 
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which makes the model spatially cooperative. Similarly, the model is spatially 
competitive under Assumptions 4 and 6 which bring down to 

d>0, e<0,6>0. 

Note that in the case of spatial cooperation (Assumptions 4 and 5), the 
positive parameters e^'s in 9i^2{xdi), Eq. (6.3), give a measure of the strength 
of the spatial cooperation: the bigger are the values of these parameters, the 
stronger is the spatial cooperation realized in the model. However, Assumptions 
4 and 5 imply < < hij /K for some positive constants hij . Therefore if the 
truncation level K is large, the implied spatial cooperation becomes limited. 



6.3. Cooperative mixed exponential auto-models by censoring 

As previously, let if be a fix positive constant. We consider the mixed cen- 
sored exponential variable X defined in §3.2. Let us recall the expression of the 
corresponding probability density function. 

/e(x) =i^'(^^)exp(0,B(x)) 

with 

T 

93)^ = ( log + XK, log A + \K, X ' 

B{x) = (l{o}(a;), l(o,K)(x), -a;l(o,K)(a;))'^. 

The reference state is K, and we notice that the components of are dependent. 
Conversely we have 



Let us consider now a mixed-state auto- model for X = {Xi, i € S}, whose 
conditional distributions belong to the family of mixed censored exponential dis- 
tributions above. For sake of simplicity, we assume spatial symmetry. Applying 
again Theorem 1, there exist a family of 3-dimensional vectors = {ri,ai,hi)^ 
and 3x3 symmetric matrices 







Uij 


tij 




llij 


Cij 


dij 




\ ^ij 


dij 





such that the energy function equals to 

Q{xi, ...,Xn)= ^(ri,aj,6i)B(.T,;) + + ^ B{xt)^/3i-jB{xj). 
les {ij} 

The natural parameters of local conditional distributions are 

/6'^,l(a:a^)\ /n\ /Srj Uy ty \ / l{Q}iXj) 

di{xdi) = 0i^2{xdi) = + X! ^''^ l(o,x)(a;j) 

\0i,3{xai)) \bij jedi \U] dij eij) \~Xjl(Q^K)\xj)^ 



(6.4) 
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Because of the censoring, cxp Q is always integrablc. but the parameters 
have to meet the requirement Oi_3{xdi) > 0. This is clearly satisfied under the 
assumption 

Assumption 7. For all i £ S, bi + X^jeOi (^iji ^ij — eijK) > 0. 

We turn now to the study of the possible cooperative or competitive features 
of the model. We first examine, for the mixed censored exponential variable X, 
the variation of E[X1(^q x]{X)] with respect to its parameters {9i, 02, O3}. If we 
denote Z' a random variable following a censored exponential distribution, we 
have 

E[Z'] 



A 

which decreases from K to when A raises from to 00. Therefore, 

E[Xl^o.K]{X)] = (1 - a)E{Z') ^ ^^J.-o^K^'lJ^'' ■ 

If the parameters 9i and 63 depend on some real variable 77 in such a way that 
both functions ^3 and 9i — 93K are decreasing (respectively, increasing) in r], 
then the expectation E[X1(q k]{X)] is an increasing (respectively, decreasing) 
function in rj. 

Coming back to E[Xil((fj^]{Xi) \ xgi], from (6.4), we have 

0i,3{xdt) = hi + ^{Ujl{o}{xj) + dijl(o,/4:)(xj) - eijXil(^o^K)ixj)}, 

jedi 

and 

{9,^1 - 9,^3K){X9,) ={n-hK) 

+ ^{{sij - ttjK)l{o}{xj) + (uy - d,jK)l(^o^K){xj) 

jedi 

- {Uj - eijK)x,l^^o^i^){xj)}. 

Let us introduce the following assumptions. 
Assumption 8. For all i,j £ S, Cij > 0, tij — CijK > 0. 
Assumption 9. For all i,j G S, Cij < 0, tij — CijK < 0. 

Proposition 3. Assume Assumption 7 holds. 

(i) The mixed auto-model whose local conditional distributions are mixed cen- 
sored exponential distributions is well-defined, 
(a) The model is spatially cooperative under Assumption 8. 
(Hi) The model is spatially competitive under Assumption 9. 

The proof is straightforward, directly derived from the definition of spatial 
cooperation given in 5.2 and the above expressions of the parameters. 

This family of auto-models is able to produce spatial cooperation as well 
as spatial competition, and this under rather light conditions, which makes 
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the model attractive. To convince, let us look at the translation invariant and 
symmetric scheme with the four nearest neighbours system of §5.3, assuming 
also spatial isotropy. Therefore, the unique interaction matrix equals 



that makes the model spatially cooperative. Analogously, Assumptions 7 and 9 
reduce to the conditions 



which guarantee the spatial competition behaviour of the model. 

7. An application to motion analysis from video image sequences 
7.1. Motion measurements from video sequences 

Motion computation and analysis are of central importance in image analysis. 
Let {Ii{t)} be an image sequence where i = (11,12) £ S denotes the pixel 
locations and t ~ 1, . . . , T the time instants in the sequence. Roughly speaking, 
a motion map at time t, X{t) = {Xi{t)} = {\\vi{t)\\} is defined as the norm 
of the underlying motion field which is estimated by a "regularised" 

minimisation of the sum of squares '^[Ii+vi(t){t + 1) — Usually some 



local smoothing procedures are needed to get a more robust motion map and 
we refer to [7] for details of these computations. 

We consider here video sequences of natural scenes. Figure 1 displays three 
sample images from each of two sequences involving a moving escalator and trees 
under wind respectively. The corresponding motion maps {Xi{t)} are displayed 
in Figure 2. Next, sample histograms from these motion maps are presented in 
Figure 3. As a matter of fact, these histograms present a composite picture. An 
important peak appears at the origin accounting for regions where no motion is 
present, while a continuous component encompasses actual motion magnitudes 
in the images. 

7.2. An mixed-state auto-model with positive Gaussian distributions 

We follow the general construction of mixed states auto-models of §4. First, we 
consider a positive mixed-state Gaussian variable X, defined in Example 3 of 
§2. Then X has the following density function : 




In this case. Assumptions 7 and 8 reduce to the conditions 



e > 0, t~eK>0, 5 + 4min(t, d - eA') > 0, 



e < 0, t-eK<0, 6 + 4 min(<, d) > 0, 



fg{x) = ^S{x) + (1 - i)6*{x)g^{x) - exp [{9, B{x)) + log 7] , (7.1) 
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Figure 1. Sample images from two videos. Top row: a moving escalator; bottom row: trees. 




it 



Figure 2. Sample motion measures {Xi{t)} from the videos of Figure 1. Top row: a moving 
escalator; bottom row: a tree (white=0; black=maximum value). 

where ^ = (2cr^)"\ ge^{x) = 2(27rcr2)-i/2 cxp{-^x2}, and 

^ = (^i,^2r=(log^i^^^,^)\ B{x)^{5*{x\-x')^ . (7.2) 

To construct auto- models for the motion maps observations {Xiit)}, we as- 
sume that the family of conditional distributions fi{xi\x^) belongs to the family 
of mixed positive Gaussian distribution given in (7.1). By Theorem 1, there ex- 
ist a family of vectors = (a^, hij^ G and a family of 2 x 2 matrices {/3.y} 
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5 6 7 




Figure 3. Sample histograms of motion measures {Xiit)} of Figure 2. 



satisfying (3ij = such that 

e,{x^^)^a,+Y,P^,B{xJ) . (7.3) 

Moreover the associated energy function is given by 

Q{xi, . . .,Xn) ^ [ai5*{xi) - bixf\ + ^ {5*{xi), -xl)(}ij{6* {xj), ~x])'^ . 
les {ij} 

(7.4) 

To analyse the motion measurements, we consider the specification of §5.3, 
namely a translation invariant and spatially symmetric auto-model with the 
four-nearest-ncighbours system and possible anisotropy between the horizon- 
tal and vertical directions. Then the parametrisation reduces to one vector 
a ~ (a, bY' and two 2x2 matrices and (3'^'^^ such that Vi, Ui = a, and 
ill Pij = unless i and j are neighbours in which case 

Moreover, the present context asks for spatial cooperation and we need further 
to constrain the parameters dk and e^, = 1, 2 to be zero. The resulting auto- 
model has four parameters <f> = (a, 6, ci,C2) and is well-defined (admissible) 
under an unique condition: b > Q. Here, we use the pseudo-likelihood method 
to estimate these parameters. 

Let us mention that in the context of image segmentation, Salzcnstcin and 
Pieczynski [12] have previously proposed a fuzzy image segmentation model 
where the fuzzy labels are a particular instance of mixed-state variables with 
values in [0, 1]. 

7. 3. Experiments 

The experiments are conducted in order to evaluate whether the model above 
can correctly account for a fundamental characteristic of an homogeneous tex- 



C. Hardouin and J.-F. Yao/ Mixed- state auto-models 



232 



turc, namely spatial isotropy or spatial anisotropy. For the present four-nearest- 
neighbours Gaussian mixed-state model, the spatial isotropy occurs if (and only 

if) Ci = C2. 

We fit this model to several motions maps like those displayed in Figure 2. 
First we consider motions from trees (bottom row of the figure). A typical set 
of parameter estimates is = (0,6,61,62) = (—5.805,3.044,3.057,2.954). The 
parameters ci and C2 are almost identical with regard to standard deviations 
of these estimates computed at other time instants of the same tree sequence. 
Therefore, the believed spatial isotropy for these motions is well reflected here. 

Next we consider the motion maps from a moving escalator (top row of 
Figure 2). Since the motion is a vertical one, we clearly have anisotropy. A typical 
set of parameter estimates is (/) = (0,6,61,62) = (—6.512,0.320,2.192,3.598). 
Therefore, the difference between ci and C2 appears to be significant and the 
mixed-state model is able to reflect the spatial anisotropy of the considered 
motion. More experiments on motion analysis can be found in [5]. 
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